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An experiment was performed in which seventeen subjects 
responded to warning signals presented on displays simulat- 
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errors committed. 
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THE PROBLEM 



I . 



A. BACKGROUND 

Schultz [1968] , in a study of information transfer in 
the modern jet cockpit, discussed the historical develop- 
ment of cockpit display systems. He found that early 
aviators relied almost entirely on direct observation for 
information concerning the performance of their aircraft. 
Airspeed was reckoned by the sound and feel of the slip- 
stream; altitude by the size of objects on the ground; an 
engine's performance by its sound, vibrations, and appear- 
ance. As aircraft performance increased there was a 
corresponding increase in the amount and precision of in- 
formation required by the pilot. Walters [1966] described 
the conventional instrument system which evolved to provide 
this information. The system consisted of a collection of 
discrete, dedicated instruments each of which sensed some 
physical quantity and displayed it in the cockpit for the 
pilot's use. 

This system, with its refinements, has remained in use 
for many years during which aircraft have become increas- 
ingly complex and sophisticated. Bernberg and Gurman [1967] 
pointed out that the conventional system has two serious 
shortcomings: First, the area of the instrument panel is 

too small to contain dedicated instruments for all the 
information available in the complex, modern aircraft pre- 
dicted for the 1980s. Second, even if some way were found 
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to display all of this information, it would be too much 
for the pilot to assimilate. 

Solution of these two problems was a point of major 
emphasis in subsequent cockpit display research from which 
the concept of an integrated cockpit emerged. Two examples 
of the development of this concept are the Digital Avionics 
Information System (DAIS) of the Air Force and the Navy's 
Advanced Integrated Modular Instrumentation System (AIMIS) . 
Czuchry, et al. [1976] and Mulley [1975] discuss the concep 
tual designs for these two systems. They find that the 
trend in cockpit display design is to eliminate as many 
conventional instruments as possible and substitute a few 
large integrated displays to four ends: (1) To improve 

information transfer in the cockpit; (2) to standardize 
cockpit layout; (3) to integrate non-standard avionics 
into standard display formats; and (4) to reduce cost. 
Figure 1 shows panel layout proposals for these two systems 

These proposed systems contain the same classes of dis- 
plays, in essentially the same positions. The heads-up 
display (HUD) and vertical situation display (VSD) have 
azimuth and elevation as a basic coordinate system and con- 
tain pitch, roll, heading, altitude, airspeed, steering 
and weapon release information. The horizontal situation 
display (HSD) is a plan-position indicator and presents 
geographic and navigation information such as heading, 
position, bearing, range, and cartography. Included on the 
panels is a new class of displays used to organize and 
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present engine and fuel data, armament data, and system 
monitoring information. These are called variously, multi- 
purpose displays (MPDs), master monitor displays (MMDs) , 
or engine management displays (EMDs) . 



B. THE MASTER MONITOR DISPLAY CONCEPT 

Lowe, et al. [1974] describes the MMD as follows. 

"The Master Monitor Display (MMD) is a data processing 
and display system conceived as an integrated compon- 
ent of an Advanced Integrated Modular Information Sys- 
tem (AIMIS) and designed to provide an aircrew with an 
integrated presentation of warning and caution, func- 
tional status, mode advisory and auxiliary data on a 
single display surface. The MMD will serve as a replace- 
ment for the multitude of lights, indicators, and gauges 
which currently provide this status information to the 
crew. " 

Mulley [1975] similarly explains: 

"The increasing number of aircraft avionics systems 
are resulting in numerous readouts and monitoring 
panels in scattered locations of the cockpit. At pres- 
ent, most of these are incandescent bulb-light abbreviated 
identifications. A proposed caution-advisory panel of 
this type for a new aircraft (F-14) called for more than 
fifty abbreviated identifications. The possibilities of 
error both in readout and responsive action are increas- 
ing. A master monitor panel would spell out the problem 
and list alternate actions. This would unburden the 
pilot from monitoring numerous displays, [and] remember- 
ing the meaning of abbreviations and the required 
actions . . . 

"The Master Monitor Display will also provide the 
pilot with warning and caution, mode advisory, func- 
tional failure, and auxiliary information, together 
with recommended action in critical situations, on a 
single display. This display will reduce the need for 
the individual warning and advisory lights that are now 
scattered throughout the cockpit." 

Flat-panel matrix displays, because of their compact- 
ness, light weight and generally low power requirements, 
seem the most likely class of display to be used to 
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implement the MMD concept. A typical proposal for such 
a display is shown in Figure 2. 
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Figure 2. MMD Display from Lowe [1974]. 
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Schultz [1968] , in a discussion of some shortcomings 
of conventional warning systems states that in such systems 
the warning devices 

" ... are associated with, and usually located near, 
instruments which deal with the airframe and associated 
aircraft subsystems such as: fire, fuel, temperature 

and the like. A few warnings are associated with flight 
status, such as stall and overspeed. Some further con- 
fusion stems from the scattered location of such warn- 
ing devices all over the cockpit, so that a pilot must 
in some cases 'work' to observe them." 

Figure 3 presents a typical example of such an arrange- 
ment, taken from the cockpit of a P-3 aircraft. 




Figure 3. Instrument Panel Showing Warning Lights. 
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Unlike the MMD, which relies on alpha-numeric coding alone, 
this conventional design codes its information both alpha- 
numerically, through the labeling of lights, (shown above 
and to the right of the engine instruments in Fig. 3) and 
spatially by the particular location of each labeled light. 
Since each light is uniquely associated with a particular 
warning, all its information is carried in its spatial code 
alone. With enough training a pilot could actually inter- 
pret these warning signals even with their labels removed. 
Although they are neither taught nor expected to identify 
warnings by light position alone, pilots regularly receive 
information through this code. When a pilot sees one or 
more lights illuminated above the gauges for a particular 
engine he knows that a problem exists with that engine even 
before he decodes the specific warnings indicated by the 
light or lights. 

A light's alpha-numeric label, while almost indispen- 
sable in interpreting the individual lights is, in a sense, 
redundant and in many cases carries insufficient information 
by itself to adequately describe the warning. Knowing that 
an "Oil Hot" light is illuminated provides insufficient 
information to allow the pilot to take corrective action. 

He must also know over which bank of instruments the light 
is located. 

A symbolic display, of the type currently proposed for 
the MMD concept, relies on alpha-numeric coding alone. In 
a human performance evaluation of matrix displays Scanlan 
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and Carel [1974] state that such symbolic displays 

" ... are those that present symbolic information 
in an abstract coded form. Because symbolic displays 
generally have only a single brightness level for the 
generation of symbols, the transmission of the code 
relies on shape differences. The code can be common, 
as in the case of alpha-numerics, or it may be a 
special set of symbols that have meaning only in a 
particular context. In either case the primary 
requirements are rapid and accurate discrimination of 
characters . " 



C. PURPOSE 

The question arises as to what effects this increased 
reliance on character identification and loss of spatial 
coding will have on the response time of subjects to a 
warning stimulus. 

In a study of the variables influencing operator 
information processing Olson [1963] exposed subjects to 
various levels of rate of information presentation, the 
number of channels through which it was presented, and the 
physical location and arrangement of the display media. 

As Figure 4 shows, the mean transformed reaction time 
increased with the number of media channels used to pres- 
ent a constant amount of information. Olson concluded that 
on the basis of his results it would be reasonable to expect 
that a subject would be able to handle a greater inflow of 
information if it could be channeled through relatively few 
media. He predicted a slower response time with a greater 
number of media coupled with lessened performance on 
other required tasks. 
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Mean Transformed Value 
For Reaction Time 




Figure 4. 



Results from Olson [1963]. 
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While it is always dangerous to extrapolate beyond the 
data base, it might be reasonable to expect that a reduc- 
tion of the number of media to one would result in contin- 
ued improvement. If so, this would be an argument in 
favor of an MMD arrangement. 

The present experiment was designed to test the hypo- 
thesis that the combined effects of the loss of spatial 
coding and reduction of media channels will result in no 
change (decrement) in the performance of subjects respond- 
ing to an MMD type display as compared to their performance 
in response to a conventional type display. 

In this experiment subjects responded to warning signals 
presented on displays simulating conventional and inte- 
grated systems. A secondary task was performed simultane- 
ously to provide task loading. 
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II. METHOD 



A. SUBJECTS 

The subjects for the experiment were sixteen male 
military officer students and one male instructor from the 
Naval Postgraduate School. The sixteen officers ranged in 
age from twenty-six to thirty-three years, the instructor 
was forty-four years old. Subjects volunteered for the 
experiment . 

B. STIMULI AND APPARATUS 

Subjects were seated at a table in a sound reduced 
booth facing a translucent projection screen onto which 
thirty-five millimeter slides were back-projected. In this 
technique, suggested by Schultz [1968], the slides used were 
black-and-white and presented warning signals in schemes 
representative of conventional or integrated designs. An 
example of a slide used to simulate a warning in a conven- 
tional system is shown in Figure 5. This slide indicated a 
fire in engine number three. The names and unique locations 
of the sixteen warning signals presented are shown in Figure 6. 
The warnings at the top were grouped by engine. Those for 
engine number one were at the left, for engine number two in 
the center, and for engine number three at the right. The 
lower matrix displayed miscellaneous warnings. 

The engine warnings were placed in logical relative 
locations and groupings on the panel. This arrangement is 
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Figure 5. Example of a 
Conventional Warning Display. 




Figure 6. Warning Labels with 
Positions on Conventional Display. 
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operationally defined to be well coded spatially. The 
miscellaneous warnings were intentionally placed at random 
with no logical order or grouping. This arrangement is 
operationally defined to be poorly coded spatially. 

Two examples of the slides used to simulate an inte- 
grated system are presented in Figure 7 . In these slides 
the position of a particular warning was not unique since 
all warnings appeared in the same place on the screen. 

The resulting ambiguity in certain labels was resolved by 
extending the labels as shown in Table I. 

TABLE I 



Extended Labels Used with the Integrated System 



CONVENTIONAL LABEL 


1 

INTEGRATED EQUIVALENT 


FIRE 


ENG 


FIRE NO. 1 




ENG 


FIRE NO. 2 




ENG 


FIRE NO. 3 


OIL PRESS 


OIL 


PRESS NO. 1 




OIL 


PRESS NO. 2 




OIL 


PRESS NO. 3 


OIL TEMP 


OIL 


TEMP NO . 1 




OIL 


TEMP NO. 2 




OIL 


TEMP NO . 3 



NOTE: All other labels were the same in both systems. 

A panel of push buttons was situated on the table in 
front of the subject and slightly to his right. Sixteen 
buttons were arranged in a 4 x 4 matrix and each was 
labeled to correspond to one of the sixteen warning sig- 
nals as shown in Figure 9. 

The nine buttons in the upper left portion of the 
panel were labeled to correspond spatially to the engine 
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Figure 7 . Two Examples 
of Integrated Warnings. 




Figure 8. Push Sutton Panel. 
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warnings in the conventional display. The remaining labels 
were assigned at random. 

A Texas Instruments TI-59 calculator mounted on a 
PC-100A printer was located on the table to the left of 
the button panel. In order to prevent inadvertent activa- 
tion of erroneous keys and to reduce distraction, the calcu- 
lator was covered so that only the numeric, decimal, 
change sign (+/-), and run/stop (R/S) keys were exposed 
and the printer was covered to conceal its output. A loud- 
speaker was placed in the booth and used to present the sub- 
ject with taped instructions and aural clicks to be used 
as part of his secondary task. 

C. PROCEDURE 

Each subject was seated in the booth and given taped 
instructions for his first task, which was to respond to 
warnings presented on the screen in front of him. 
(Instructions to the subjects are contained in Appendix A.) 
He was told that when a warning appeared he was to press 
the labeled button corresponding to that warning as quickly 
and as accurately as he could. The timing was started 
when the projector shutter opened and stopped when the 
subject pressed a button. He was shown examples of warn- 
ings in the conventional system and given a practice ses- 
sion in that system during which sixty-four slides were 
presented at four second intervals with each warning 
repeated four times at random. 
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Due to external constraints placed on the length of the 
experiment it was decided to give no formal practice session 
using the integrated display. To compensate for this omis- 
sion, when a subject first saw the integrated display 
(during a scored run) the first slide presented was counted 
as a practice/familiarization trial and the reaction time 
for that slide was not used in subsequent analysis. This 
decision seemed reasonable since the same push buttons were 
used with both displays and because the integrated presen- 
tation was simple and straightforward and, once seen, was 
easily interpreted. 

The subject was then given instructions for his second 
task to be performed simultaneously with the first. He was 
told that his task was to count and record on the calculator 
the number of clicks presented at intervals over the loud- 
speaker. He was told to record the clicks by pressing the 
key corresponding to the number of clicks, then pressing the 
R/S key. He was told to use his left hand for the aural 
task and his right hand for the visual task. The aural 
stimuli were present in groups of four, five, six, or seven 
clicks in a manner similar to that used by Garvey and Knowles 
[1954]. The subject was given a short practice session dur- 
ing which he responded to four groups of clicks. 

After the two practice sessions the subject was told 
that he would then begin a scored run during which he would 
perform both tasks simultaneously. He was instructed to do 
as well as he could on both tasks. The group to which the 
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subject was assigned determined whether he received the 
conventional or integrated system first. In either case 
during the scored runs the time between slide presentations 
was equally likely to be any integer number of seconds from 
eight to sixteen. Each of the sixteen warnings was repli- 
cated four times at random for a total of sixty-four 
presentations per run. 

During the scored runs the groups of aural clicks were 
presented at about seven second intervals. Ninty-nine 
groups were presented during each run. Each subject was 
exposed to the same sequence and timing of slides and 
clicks . 

The second scored run for each subject was identical 
to the first except that the type of system simulated was 
changed to integrated or conventional as appropriate. 

At the completion of the subject's second run he was 
asked to fill out a personal data questionnaire and 
requested not to discuss the experiment with other subjects. 

D. DESIGN 

Data from the experiment were analyzed according to a 
three-way factorial analysis of variance (ANOVA) [Winer, 
1962] . The three main factors were order of presentation 
(2 levels) , display types (2 levels) , and light groups 
(2 levels) . Figure 9 is a conceptual model of the 
experiment. 

The dependent variable for the study was mean reaction 
time. The subjects were divided into two groups, one 
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Figure 9. Conceptual Model of 



receiving the conventional display first and one receiv- 
ing the integrated first. 
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Ill 



RESULTS 



Table II is a summary of the results of the experiment. 



TABLE II 



Mean Response Times by Subjects 
Lights, and Runs 





ENGINE LIGHTS 


MISCELLANEOUS LIGHTS 




CONVENTIONAL 


INTEGRATED 


CONVENTIONAL 


INTEGRATED 


SUBJECT 


(First) 


(Second) 


(First) 


(Second) 


1 


1.27 


1.77 


1.98 


1.92 


2 


1.07 


1.27 


1.33 


1.37 


3 


1.42 


1.72 


1.82 


1.96 


4 


1.00 


1.26 


1.37 


1.37 


5 


1.25 


1.42 


1.54 


1.54 


6 


1.32 


1.76 


1.48 


1.83 


7 


1.69 


1.82 


2.03 


1.90 


8 


1.24 


1.56 


1.66 


1.89 


9 


1.29 


1.94 


1.75 


2.01 


Mean 


1.28 


1.61 


1.66 


1.75 


S. D. 


0.20 


0.25 


0 . 25 


0.26 




CONVENTIONAL 


INTEGRATED 


CONVENTIONAL 


INTEGRATED 


SUBJECT 


(Second) 


(First) 


(Second) 


(First) 


10 


1.08 


1.84 


1.46 


2.49 


11 


1.26 


1.92 


1.54 


2.26 


12 


1.28 


1.95 


1.45 


2.26 


13 


1.40 


1.97 


1.73 


2.24 


14 


1.07 


1.58 


1.17 


1.68 


15 


1.34 


1.96 


1.66 


2.19 


16 


1.37 


2.13 


1.54 


2.32 


17 


1.65 


2.39 


1.98 


2.56 


Mean 


1.31 


1.97 


1.57 


2.25 


S.D. 


0.19 


0.23 


0.24 


0.26 



These results can be seen graphically in Figures 10 and 
11. An analysis of variance (ANOVA) (Table III) indicated 
that there was a strong difference between displays and 
between light groups with a high degree of interaction 
between displays and light groups, between displays and 
order of presentation, and a significant interaction among 
light groups, displays, and order of presentation. 
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Figure 11. Mean Response Time for Miscellaneous Lights. 



TABLE III 



Analysis of Variance for the Experiment 



SOURCE 


d. f . 


S.S. 


M.S. 


F 


P 


Between Subjects 












Order (0) 


1 


0.64 


0.64 


3.44 


0.083 


Error 


15 


2.78 


0.19 






Within Subjects 












Lights (L) 


1 


1.20 


1.20 


99.64 


0.000* 


L x 0 


1 


0.00 


0.00 


0.04 


0.835 


Error 


15 


0.18 


0.01 






Displays (D) 


1 


3.31 


3.31 


170.81 


0.000* 


D x 0 


1 


0.90 


0.90 


46.57 


0 . 000* 


Error 


15 


0.29 


0.02 






L x D 


1 


0.05 


0.05 


9.26 


0.008* 


L x D x 0 


1 


0.07 


0.07 


13.53 


0.002* 


Error 


15 


0.08 


0.01 






* Significant at 


a = 0.01 










TOTAL 


67 


9.50 








NOTE: Values are 


rounded to 


two ( 


decimal 


places for 





tabulation . 



2? 



IV. DISCUSSION 



When considering the difference between displays it 
is convenient to consider the engine warnings and the 
miscellaneous warning separately. 

In the case of the engine warnings it can be seen in 
Figure 10 that the subjects responded faster to the conven- 
tional display than to the integrated one regardless of 
the order of presentation. This result stems from the fact 
that in the conventional system the positions of the engine 
warnings and their associated push buttons corresponded 
spatially. As a result the subject, after a few minutes of 
practice, could press the correct button without actually 
having to read the warning label. This importance of 
compatability of display and control with respect to rela- 
tive spatial location is consistent with the findings of 
Garvey and Knowles [1954] , Chapanis and Lockhead [1965] , 
and Poock [1969] . This experimenter feels that this situ- 
ation accurately simulates a pilot's response to warnings 
that are well known to him and well coded spatially in the 
cockpit. (It should be noted here that the distinction 
made between "engine" and "miscellaneous" warnings is one 
of degree of spatial coding. The words "engine" and 
"miscellaneous" are used only to distinguish those lights 
that were well coded from those that were poorly coded in 
the conventional display. The fact that the well coded 
warnings were associated with the engines has no significance 
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per se.) With the integrated display the subject had to 
first read the display and then respond to it, thus slowing 
his response time as shown. Heimstra and Ellingstad [1972] 
in a discussion of control coding also noted this extra 
time requirement to read labels and cite it as one of the 
disadvantages of using alpha-numeric coding. 

In the case of the miscellaneous warnings the conven- 
tional display also usually produced faster mean reaction 
times. However, an examination of Figure 11 reveals that 
when a subject received the integrated system second, his 
performance on the two displays was nearly equivalent. 

Only two of these nine subjects reacted to the conventional 
display significantly faster (a = 0.05). This result seems 
to indicate that the subjects were still learning through- 
out the experiment and that, with continued practice, the 
integrated display might prove to be as effective as the 
conventional. While this might be true in an experimental 
sense, in an actual flight setting the appearance of a 
warning signal is a relatively rare occurrence. This 
experimenter feels that measurements taken early in the 
subject's learning period more accurately approximate his 
performance in an actual flight situation. 

Learning curves for the seventeen subjects were plotted 
by light groups and displays. Examination of the curves 
revealed only a very slight learning phenomenon. These 
results may, however, have been obscured by the interac- 
tion between the primary and secondary tasks. 
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The ANOVA also revealed a significant difference in 
mean reaction times between the engine and miscellaneous 
warnings. Reference to Figures 10 and 11 shows that the 
engine lights were reacted to faster than the miscellaneous 
lights in all cases. This result seems at first to be 
inconsistent. One would expect that there would be a dif- 
ference using the conventional display since the push 
buttons were deliberately labeled to enable the subject 
to respond to the engine warnings without having to read 
them. But one would not expect to see such a difference 
using an integrated display in which all the warnings had 
to first be read then reacted to. The observed difference 
might be explained by the fact that the spatial coding of 
the engine push buttons shortened the subject's search time 
in both cases by enabling him to recode the alpha-numeric 
information on the button panel into a more economic 
spatial code in a manner described by Welford [1968] in his 
chapter on economy of decision. It is noted, however, that 
the difference between the engine and miscellaneous warn- 
ings was, as expected, more pronounced with the conventional 
system. 

The interaction between displays and order of presenta- 
tion was also shown to be significant. The data indicate 
that the integrated display was more sensitive to the order 
of presentation than was the conventional. Mean response 
times with the conventional display differed very little 
from subjects who received that display first to those who 
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received it second. However, those receiving the inte- 
grated display second reacted significantly faster than 
those who received it first. This interaction might be 
explained as follows. The practice run for all subjects 
was made using the conventional display. The control/dis- 
play (C/D) correspondence for the engine lights was learned 
rapidly and the subject could quickly respond to these 
lights without having to read them. When his first scored 
run was also made with the conventional system this knowl- 
edge carried over into that run and the subject's overall 
response time was lowered. But while reacting almost 
automatically using the spatial C/D relationships he was 
also learning the button locations in an absolute sense. 

This knowledge of absolute button locations then carried 
over into the second scored run (on the integrated system) 
reducing his search time for that run. However, when the 
first scored run was made using the integrated system the 
absolute locations of the buttons was still uncertain and, 
since no spatial cues were given by the display, the subject 
lost the luxury of responding automatically while learning 
these locations. Instead, his reaction time was, in part, 
dependent on this knowledge and slowed accordingly. On his 
second scored run (with the conventional system) the spatial 
C/D relationships again quickly enabled him to respond 
automatically with reaction times comparable to those by 
subjects who had the conventional display first. 
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Another significant interaction was that between lights 
and displays. It can be accounted for by observing that 
the miscellaneous lights were effected less by different 
displays than were the engine lights. 

The significant three-way interaction among lights, 
displays, and order of presentation is indicative of the 
fact that the performance on conventional and integrated 
displays was nearly equivalent for miscellaneous lights by 
subjects who received the conventional display first, while 
in all other cases the performance was significantly 
different . 

An examination of the errors made while responding to 
these systems is also of interest. There were no errors of 
omission, every warning was responded to in the time avail- 
able. Using the conventional system there were only five 
errors of commission and no subject made more than one. 
Using the integrated system, however, four subjects made 
one error, four made two errors, three made three errors, 
and one made five errors for a total of twenty-six (over 
five times the number made using the conventional system) . 

Performance on the secondary task seems to have been 
independent of both error rate and reaction time for the 
primary task and fairly consistent across displays and 
subjects. Eighty- three secondary task errors were made on 
runs with the conventional system and seventy-two with the 
integrated. Eight subjects' secondary performance was 
better with the integrated display and nine did better 
with the conventional. 
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It seems, from the results of this experiment, that 
the hypothesized decrease in reaction time due to media 
reduction observed by Olson [1963] either did not occur 
or was of less magnitude than the increase in reaction 
time due to the loss of spatial coding. 
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V. CONCLUSIONS AND RECOMMENDATIONS 



It is recognized that an integrated warning system 
offers many advantages over a conventional one and that 
such a system will inevitably be placed in the cockpits of 
future fighter and attack aircraft. Its versatility, light 
weight, and compactness make it an attractive choice in a 
setting in which these factors are often critical. 

It should be noted, however, that such a system is not 
without its disadvantages. This experiment has shown that 
mean reaction time to warnings presented on the integrated 
display was slower than that to those presented on the con- 
ventional display. Whether or not this statistically sig- 
nificant difference is significant in an operational sense 
must be determined in light of other factors such as the 
criticality of the warning involved and its sensitivity to 
reaction delays. 

Further, it was observed that the number of errors 
committed with the integrated display was much greater 
than with the conventional, an unhypothesized result which 
warrants further investigation. 

The author believes that further studies of possible 
shortcomings of an integrated display should be undertaken 
before such a system is installed in larger aircraft in 
which panel space and weight requirements are not as criti- 
cal and for which a conventional system remains a viable 
alternative . 
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APPENDIX A 



TAPED INSTRUCTIONS TO SUBJECTS 

During this experiment you will be asked to perform 
two simultaneous tasks. The first consists of responding 
to slides presented on the screen in front of you. When a 
slide appears, you should press the appropriate button on 
the panel in front of you as quickly and as accurately as 
possible. You will be scored on both speed and accuracy. 

This is an example of one type of slide. It simulates 
a type of warning system used in some aircraft. The warn- 
ings for engine number one are located at the left; for 
engine number two, in the center; and for engine number 
three, at the right. The lower panel displays miscellan- 
eous warnings. 

Take a few minutes to study the pattern and become 
familiar with where the individual warnings are located, 
both on the slide and on the button panel. [Two minutes 
given for study.] 

A short practice session will follow. Please respond 
to the slide by pressing the approrpriate button as quickly 
and as accurately as you can. [Practice session follows.] 

Your simultaneous task will be to count and record the 
number of clicks in a series of clicks presented to you on 
this recorder. After each series of clicks, key the total 
number of clicks that you counted into the calculator 
located to your left. Do this by first keying in the 



37 



total, then pressing the run/stop key in the lower left- 
hand corner of the keyboard. It is important that you 
respond to each series whether or not you are sure of 
your answer. If you are not sure, you may respond by 
simply pressing the run/stop key alone, without keying in 
an answer. It is important that you respond to every series 
and that you press the run/stop key only once per series. 

You may not change an answer once it has been keyed in. 

If you think the answer that you have keyed is wrong , press 
the run/stop key anyway and go on to the next series. 

A short practice session will follow, please respond 
as directed. [Practice session on aural task follows.] 

A scored run now follows, use your left hand to respond 
to the clicks and your right hand to press the warning 
push buttons. You should try to do as well as you can on 
both tasks. 

[The following additional instructions were given for 
runs using the integrated system. ] 

On this run the slides you will see are different 
from the ones you saw on the practice run. Their meaning 
will be obvious and you should respond to them the same 
way you did to the others. 



38 



LIST OF REFERENCES 



1. Bernberg , R. E. and Gurman , B., "The Integrated 

Cockpit," Space/Aeronautics , p. 68-74, 

November 1967. 

2. Chapanis , A. and Lockhead, G. R., "A Test of the 

Effectiveness of Sensor Lines Showing Linkages 
Between Displays and Controls," Human Factors, 

V. 7, p. 219-230, June 1965. 

3. Czuchry, A. J. and others, Mid-1980s Digital Avionics 

Information System Conceptual Design Configuration , 
Air Force Human Resources Laboratory Report 
AFHRL-TR-7 6-5 9, July 1976. 

4. Garvey, W. D. and Knowles, W. B., "Response Time 

Patterns Associated with Various Display-Control 
Relationships," Journal of Experimental Psychology , 
V. 47, p. 315-322, April 1954. 

5. Heimstra, N. W. and Ellingstaa, V. S., Human Behavior , 

A Systems Approach , p. 457, Brooks/Cole, 1972. 

6. Lowe, R. W. and others. Advanced Technical Evaluation 

of a Master Monitor Display , Hughes Aircraft 
Company Report HAC-P74-457, October 1974. 

7. Mulley, W. G. , Program Plans for AIMIS (Advanced 

Integrated Modular Instrumentation System) , Naval 
Air Development Center Report NADC-75354-50 , 

31 December 1975. 

8. Olson, P. L. , "Variables Influencing Operator Informa- 

tion Processing," Human Factors , V. 5, p. 109-116, 
April 1963. 

9. Poock, G. K. , "Color Coding in Compatible and Non- 

compatible Display-Control Arrangements," Journal 
of Applied Psychology , V. 53, p. 301-303, 

August 1969. 

10. Scanlan , L. A. and Carel , W. L. , Human Performance 

Evaluation of Matrix Displays: Literature and 

Technology Review, Hughes Aircraft Company Report 
HAC P75-468 , D1755, June 1976. 

11. Schultz, W. C. , Problems of Information Transfer in 

the Modern Jet Cockpit , Cornell Aeronautical Labora- 
tory Report CAL-IH— 2 2 3 5-B , December 1968. 



39 



12. Walters, D. J. , "Cockpit Displays," AGARD Conference 

Proceedings No. 17 , Paris, France, North Atlantic 
Treaty Organization, Part 2, p. 959-977, 

September 1976. 

13. Welford, A. T., Fundamentals of Skill , p. 179-180, 

Methuen, 1968. 

14. Winer, B. J. , Statistical Principals in Experimental 

Design , McGraw-Hill, 1962. 



40 



INITIAL DISTRIBUTION LIST 



No. Copies 
2 



1. Defense Documentation Center 
Cameron Station 
Alexandria, Virginia 22314 

2. Library, Code 0142 2 

Naval Postgraduate School 

Monterey, California 93940 

3. Department Chairman 1 

Department of Operations Research 

Naval Postgraduate School 
Monterey, California 93940 

4. Asst. Professor D. E. Neil, Code 55Ni 2 

Naval Postgraduate School 

Monterey, California 93940 

5. CDR L. E. Waldeison , Code 55Wd 2 

Naval Postgraduate School 

Monterey, California 93940 

6. LCDR Joseph D. Mazza, USN 1 

R.D. #2 Box 104K 

Summit Drive 

Lake George, New York 12845 



41 




172709 



Mazza 

A comparison of in- 
tegrated and conven- 
tional cockpit warning 




ystems . 



thesM399 

A comparison of integrated and convent o 




3 2768 001 03341 8 

DUDLEY KNOX LIBRARY 



